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. Abstract 

Random walks on graphs are widely used in all sciences to describe 
. - a great variety of phenomena where dynamical random processes are af- 

y ' fected by topology. In recent years, relevant mathematical results have 

^ , been obtained in this field, and new ideas have been introduced, which 

^ ' can be fruitfully extended to different areas and disciplines. Here we aim 

at giving a brief but comprehensive perspective of these progresses, with 
a particular emphasis on physical aspects. 
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1 Introduction 

A graph is the most general mathematical description of a set of elements con- 
nected pairwise by some kind of relation. Therefore, it is not surprising that 
graph theory has been successfully applied to a wide range of very different dis- 
ciplines, from biology to social science, computing, psychology, economy, chem- 
istry and physics. 

In recent times, physicists have been mainly interested in graphs as models of 
complex systems, in condensed matter and in network theory. Indeed, these 
structures have proven to be very useful to describe inhomogeneous structures 
such as disordered materials, glasses, polymers, biomolecules as well as electric 
circuits, communication networks, statistical models of algorithms, and appli- 
cations of statistical mechanics to different (non physical) systems. 

The function of graphs in physics, however, is not purely descriptive. Geom- 
etry and topology have a deep influence on the physical properties of complex 
systems, where the presence of a large number of interacting degrees of freedom 
typically matters more than the interaction details. In fact, the specific interest 
of a physicist concerns the properties of a graph which most affect the dynamical 
and thermodynamical behaviour of the system it describes. On the other hand, 
the study of complex systems requires the introduction of statistical methods, to 
give an effective description of a number of quantities which, otherwise, would 
be too difficult to control. 

Random walks are probably the simplest stochastic process affected by topol- 
ogy and, at the same time, the basic model of diffusion phenomena and non- 
deterministic motion. They have been extensively studied for decades on regular 
structures such as lattices, and most of the common wisdom concerning them 
relies on the results obtained in this particular geometry. The richer topology of 
a generic graph can have a dramatic effect on the properties of random walks, 
especially when considering infinite graphs, which are introduced to describe 
macroscopic systems in the thermodynamic limit. There, the asymptotic be- 
haviour at long time typically exhibits universal features, only depending on 
large scale topology. On lattices, such features are known to be related to the 
Euclidean dimension only. On general graphs, universality allows to generalize 
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the concept of dimension to inhomogeneous structures, providing a very power- 
ful tool to investigate a large class of different physical models, apparently not 
connected to diffusion processes. On the other hand, a new and unexpected 
phenomenon arises in presence of strong inhomogeneity, namely the splitting 
between local and average properties. This provides a fundamental conceptual 
framework to investigate complex systems even from an experimental point of 
view. 

Most results concerning random walks on graphs in physics have been obtained 
in the last two decades and are scattered in a large number of technical papers. 
This review is intended to provide the reader with a rigorous, self-contained 
and up to date account of the present knowledge about this subject. Particu- 
lar attention has been paid to give a simple and general framework effectively 
resuming rather different results. As for specific calculations, we refer to bib- 
liography, unless required by clarity reasons. The emphasis is always put on 
the physical meaning. The reader more interested in formal aspects can find a 
presentation focused on mathematics in another recent review PP. 
The paper is organized as follows: In the first sections we give a brief mathe- 
matical description of graphs and random walks, introducing the language and 
the formalism we will use through the whole article. Then we present a simple 
treatment of the finite graphs case, before dealing with infinite graphs. The 
latter require the introduction of specific concepts, which are fully discussed in 
an introductory section. Then, the asymptotic behaviour of random walks on 
infinite graphs is studied and used to define the type problem and the spectral 
dimension. The difference between local and average properties is evidenced in 
the following sections. The concluding chapters are devoted to the analysis of a 
large class of specific graphs and to the relations of random walks with different 
physical problems. 

2 Mathematical description of graphs 

Let us begin by introducing the basic mathematical definitions and results con- 
cerning graphs .2 . 

A graph Q is a countable set V of vertices (or sites) (i) connected pairwise by 
a set E of unoriented links (or bonds) — If the set V is finite, G 

is called a finite graph and we will denote by N the number of vertices of Q. 
Otherwise, when V is infinite, G is called an infinite graph. A subgraph S oi G 
is a graph whose set of vertices S CV and whose set of links E' C E. 
A path Ci^j in G connecting points i and j is a sequence of consecutive links 
{{i, k){k, h) . . . (n, TO)(m, j)} and a graph is said to be connected, if for any two 
points i,j G V there is always a path joining them. In the following we will 
consider only connected graphs. 

Every connected graph G is endowed with an intrinsic metric generated by the 
chemical distance which is defined as the number of links in the shortest 
path connecting vertices i and j. 

A particular class of graphs, often occurring in physical applications, is char- 
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actcrizcd by the absence of closed paths containing an odd number of hnks. 
These graphs are cahed bipartite, since we can divide their sites into 2 sets Vi 
and V2 such that the points of Vi are connected by a Hnk only to points V2 
and viccvcrsa. Square and hypcrcubyc lattices arc the most typical examples of 
bipartite graphs, as well as all trees (graphs without closed self-avoiding paths). 
The graph topology can be algebraically represented introducing its adjacency 
matrix Aij given by: 

_ r 1 if{i,j)€E 

^*^- \ ii{i,j)^E 
The Laplacian matrix is defined by: 

Aij = ZiSij — Aij (2) 

where Zi = J2j ^ij^ the number of nearest neighbours of i, is called the coordi- 
nation number of site i. 

In order to describe disordered structures wc introduce a generalization of the 
adjacency matrix given by the ferromagnetic coupling matrix Jjj, with ^ 
Aij = 1 and sup(jj) Jij < 00, inf(i Jij > 0. One can then define the 

generalized Laplacian: 

Lij — Ji^ij '^ij (3) 

where = J2i Jij- 



3 The random walk problem 

Let us now introduce the so called simple random walk on a graph Q. Assuming 
the time {t) to be discrete, we define at each time step t the jumping probability 
Pij between nearest neighbour sites i and j: 

Pij = ^ = {Z-^A)ij (4) 

where Zij — ZiSij. 

This is the simplest case we can consider: the jumping probabilities are isotropic 
at each point and they do not depend on time; in addition the walker is forced 
to jump at every time step. As we will sec later, the last condition, i.e. the 
impossibility of staying on site, although crucial for the short time behaviour, 
has no significant influence on the long time regime. 

Usually, the random walk problem is considered to be completely solvable if, 
for any i,j £ Q and t & N, we are able to calculate the functions Pij{t), each 
representing the probability of being in site j at time t for a walker starting from 
site i at time 0. These probabilities are the elements of a matrix P = 
which is equal to the t-th power of the jumping probabilities matrix p = ||ftj||: 

Pijit) = {p%j . (5) 
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The relation Q can be easily proven by induction on t. It also has an interesting 
physical interpretation as a sum over paths; developing the matrix products term 
by term we can write the whole expression as 

P^,{t) = iP%^ E ^(^-.W) (6) 

where the sum is over all steps paths between i and j. The weight w{Ci^j 
is the probability for the walker of going from i to j following exactly the path 

(fc,;)6C,^j(t) 

the product being over all the t links belonging to the path. 
The calculation of all Pij{t), which is straightforward as far as relatively small 
graphs are concerned, for large or infinite graphs becomes practically impossi- 
ble and, above all, little significant. In fact, for large systems we are mainly 
interested in global and collective properties as it typically happens in statisti- 
cal physics. Therefore, a small subset of all these quantities is usually chosen, 
together with some other related to them, which give an effective physical de- 
scription of the random walker behaviour. The most relevant of them is from 
many points of view the probability Pii{t) of returning to the starting point 
after t steps, also called the random walk autocorrelation Junction. As we will 
see, its asymptotic behaviour gives the most direct characterization of the large 
scale topology for infinite graphs. A related quantity is the average number 
Pa of returns to the starting point i, which can be generalized to the average 
number Pij of passages through j starting from i: 

t 

P.,^ hm ^P,,(fc), (8) 

k=0 

where the limit can be infinite. 

The mean displacement ri{t) from the starting site i after t steps is deeply 
related to the diffusion properties and is defined as 

r,it) = Y,r^JP^J{t) (9) 

j 

Notice that, unlike the case of random walks in continuous Euclidean space, 
here we consider r instead of r^, the latter having no particular significance in 
absence of Euclidean metric. 

The quantities introduced up to now are not " sensible to the history" . Indeed, 
we can in principle determine all of them simply by considering the situation 
of the walker at time t regardless of his previous behaviour. In order to keep 
track of what happened before the instant t, a different class of functions is 
introduced, starting with the first passage probability Fij{t). The latter denotes 
the conditional probability for a walker starting from i of reaching for the first 
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time the site j ^ i in t steps. For i = j the previous definition would not be 
interesting, being the walker in i at i = by definition. Therefore, one defines 
Fa (t) to be the probability of returning to the starting point i for the first time 
after t steps and one sets Fii{0) = 0. In spite of the deeply different nature of 
P and F, a fundamental relation can be established between them if all time 
steps form to t are taken into account (in other words, we have to give up the 
time locality): 

t 

P^J it) = E i'^^^n {t~k) + S,,Sto. (10) 

fe=0 

This can be easily obtained by considering that each walker which is in j at 
time t only has two possibilities: either it gets there for the first time, or it has 
reached j for the first time at a previous time k and then it has returned there 
after t — k steps. The first passage probability is in turn connected to other 
meaningful history dependent quantities. The probability Fij of ever reaching 
the site j starting from i (or of ever returning to i, if i = j) is given by 

oo 

F^=Y.P^ii^) (11) 

By Si (t) we denote the average number of different sites visited after t steps by 
a walker starting from i. Its relation to Fijit) is 

t 

k=i j 

Finally, the first passage time tij , i.e. the average time at which a walker starting 
from i, and passing at least once through j, reaches j for the first time (or returns 
for the first time to if i = j) is 

^ hm (13) 

The simple random walk can be modified to give a richer behaviour and to de- 
scribe more general physical problems. Indeed, one can introduce anisotropic 
jumping probabilities by substituting in the adjacency matrix with a ferro- 
magnetic coupling matrix: 

P.. - ^ - {I-'Jh (14) 

where 1^ = lidij and li — J^k Depending on the specific properties of , 
this can produce only local effects or introduce a global bias which destroys the 
leading diffusive behaviour giving rise to transport phenomena. 
Moreover, one can relax the constraint of jumping at each time step by introduc- 
ing waiting and traps on the sites. The jumping probabilities are then modified 
to: 

P->3 = T I I J (15) 
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where both Wi and di are real positive numbers. From ((TH|l . Wi/{Ii + Wi + di) 
is the probabihty for the walker to stay on site i instead of jumping away and 
di/{Ii -\- Wi + di) the probability of disappearing (or dying, or being trapped 
forever) at site i. As we will see later, waiting only affects the short time 
behaviour, while traps can dramatically modify also the long time asymptotic 
properties. 



4 The generating functions 

Even if we consider only the few fundamental quantities devised at the end of 
the last section, their direct calculation can be in practice a hard or impossible 
task on general graphs. However, a powerful indirect mathematical technique 
exists allowing overcoming a series of typical difficulties: this is the discrete 
Laplace transform, which maps a time function into its generating function. 
The generating function /(A) of f{t)\s defined by: 

oo 

/(A)-^A7(0 (16) 

where A is a complex number. The inverse equation giving f{t) from /(A) is 

9*/(A) 



fit) 



(9A* 



(17) 

A=0 



This equation is useful as fare as we are interested in small t behaviour, but it 
becomes absolutely ineffectual in the study of asymptotic regimes for t ^ oo. In 
this case a very powerful tool is provided by the Tauberian theorems, relating 
the singularities of /(A) to the leading large t behaviour of /(t). We give here a 
rather general Tauberian theorem, which is particularly useful when dealing with 
random walks. The main assumption we make concerns the analytical form of 
the leading singularity: we only consider power laws and logarithmic behaviours, 
since all cases discussed in this paper as well as all physically meaningful cases 
belong to this class. Suppose that /(A) has its singularity nearest to A = in 
A = 1. and that /(I — e), for e ^ 0+ goes as 

oo 

/(I - e) - /i(e) + consi Jl (Mn(l/e))"^'^ (18) 

1=0 

where ' Inx = ln*~^ In x, with ^Xnx = x e h{e) is finite for e — > 0"*". 
Then, for t oo 

oo 

fit) - const'r-' Yl ' In''^'^ (0 (19) 



i=0 



where P{i) are related to a{i) by 



, a(0) - 1 ^ for i = 

~^ ^{i- m){a{i) + 1) - 1 - (5,,™/(rf/2) otherwise ^ ' 
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where 

m = min{j > 0|/3(i) 7^ -1} (21) 

and _ 

/ (d/2) = ( 1 if is integer (22) 
^ ^ 1 otherwise 

The constant const' is in general a function of const and of all the exponents 
appearing in the previous formulas. We don't give here its rather involved 
explicit expression, since it is not relevant to the purposes of this paper. 
The generating functions are usually easier to calculate, since they allow exploit- 
ing some peculiar properties of random walks functions. Moreover, a series of 
relevant random walk parameters which are non-local in time, can be obtained 
directly from generating function, without calculating the corresponding time 
dependent quantities. A good example is given by Py , Fij, and tij which are 
related to (A) and Py (A) by 

P, -^lmi_Py(A) (23) 
F.,^F,,il) (24) 
^ hnr ^l^ifM (25) 

The basic property of random walks generating functions arise from the decon- 
volution of ea. HlU|l . which after some straightforward steps becomes 

P.,(A)4(A)P,,(A)+% (26) 

In other words, the relation which was non-local in time becomes local in A. As 
we will see in practical application, many iteration techniques for the analytical 
calculation of generating functions are based on this property. 



5 Random walks on finite graphs 

Finite graphs consist of a finite number of sites and links. In principle, every 
physical structure is composed of a finite number of elements, but it is well 
known that a series of behaviours occurring in macroscopic systems are better 
described in the thermodynamic limit. Indeed, the typical singularities and 
power laws characterizing phase transitions and asymptotic regimes, such as 
large scale, long times, low temperature and low frequency behaviours, can only 
be found on infinite graphs. 

However, finite graphs are appropriate when dealing with mesoscopic structures 
and finite size effects. The random walk problem on finite graphs is simplified by 
the finiteness of the adjacency matrix. In fact, the analytical study is reducible 
to a spectral problem on a real finite-dimensional vector space, and numerical 
simulations are easily implemented by Monte Carlo techniques. 
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Let us first consider the case of random walk without traps, whose jumping 
probabilities are given by H15|l with c?i = V i. The matrix elements pij 
satisfy the relations 

Py>0 V i,j (27) 

N 

^Py=l V i (28) 

defining a stochastic matrix. 

The stochastic matrices we are considering exhibits different properties accord- 
ing to the some general features of the graph and of the jumping probabilities 
We distinguish two cases: 

1. cl If is not bipartite, or if it has a staying probability on at least one site, 
then it has only one eigenvalue Pmax with maximal modulus and Pmax = 1 ■ 
Moreover, the eigenvector corresponding to Pmax has the same entry on 
each site (usually one chooses Vmax = (l;ljli---il) for simplicity) 

2. c2 If is bipartite without staying probabilities, then the spectrum of p is 
symmetric with respect to the origin of the complex plane. Therefore, in 
addition to Pmax it has a second maximal modulus eigenvalue Pmin = — 1- 
The eigenvector Vmax has the same properties of the previous case, while 
Vmin has all entries on Vi equal to the same number v and all entries on 
V2 equal to —v (usually one chooses v = 1) 

In case cl, one can easily show that the random walk is ergodic, i.e. that it 
admits limit probabilities for t —^ 00: 

P,^ ^ \im P,,(t) V I, J (29) 

and that 

P.7 = ^ V ^,J. (30) 

This means that, independently of the initial conditions, the asymptotic proba- 
bilities are the same over all the graph sites. Moreover, this uniform limit value 
is reached exponentially and the exponential decay of each matrix element is no 
slower than p|, p2 being the second greatest eigenvalue of pij. 
In case c2, the random walk is not ergodic. In particular, we have 

P,,{t) = (31) 

for all t such that t — is odd. On the other hand, considering for each couple 
of sites i and j only the values t'^j of t having the same parity as r^, one can 
show that 

P,^ = hm P,,it',^) V z,j (32) 

t . . — ^Ctt 

with 

PiT-l V (33) 
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and the limit is reached exponentially as in case 1. 
Similarly, one can easily prove that 



\imF,^{t)^0 V I, J (34) 

and 

hm S'j(t) = iV y i (35) 

t — *oo 

the limit values being reached exponentially. 
Moreover, 

Pij = oo V i, j (36) 

F^j=l V i,j (37) 

and 

tij <oo V i,j (38) 

The introduction of at least one trap, setting di > for at least one site i in H15|l . 
dramatically changes the random walk behaviour. The jumping probabilities 
matrix p is no longer stochastic, since condition 128|) is not satisfied. However, 
condition H27I) (i.e. non-negativity) still holds, implying relevant properties. We 
can still distinguish between case 1 and 2, but the corresponding properties are 
modified as follows: 

1. If C/ is not bipartite, or if it has a staying probability on at least one site, 
then it has only one eigenvalue Pmax with maximal modulus and Pmax < 1- 
Moreover, the entries Vmaxi of the eigenvector Vmax, corresponding to 
Pmax, have the same sign, and Vmax is the only eigenvector having such a 
property. 

2. If Q is bipartite without staying probabilities, then the spectrum of p is 
symmetric with respect to the origin of the complex plane. Therefore, 
in addition to Pmax < 1 it has a second maximal modulus eigenvalue 
Pmin = —Pmax- The eigenvector Vmax has the same properties of the 
previous case, while Vmin can be chosen in such a way that all its entries 
Vmini On Vi are equal to Vmaxi and all its entries Vminj on V2 equal to 

^max j • 

In both cases the random walk is ergodic and the limit probabilities vanish: 

P^^^O V I, J. (39) 

However, in case 2 the time parity still has to be taken into account and l|31|l 
holds. Moreover, the asymptotic decay is exponential and no slower than pl^ax- 
Finally, as for the other random walk functions we get 

limF„(i) = V i,j (40) 

lim S^{t)<N y i (41) 
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the limit values being reached exponentially, 

Pij <oo V i,j (42) 

Fij<l V i,j (43) 

tij <oo V i,j (44) 



6 Infinite graphs 

When dealing with macroscopic systems, composed of a very large number N 
of sites, one usually takes the thermodynamic limit N ^ oo. This means that 
wc have to consider infinite graphs, i.e. graphs composed by an infinite number 
of sites. This is particularly convenient for two main reasons: 

• first of all, a single infinite structure effectively describes a very large 
(infinite, indeed) number of large structures having diff'erent sizes, but 
similar geometrical features 

• the singularities in thermodynamic potentials typical of critical phenom- 
ena as well as a scries of universal asymptotic behaviours only occur on 

infinite structures. 

As for random walks on large real structures, the time dependence of physical 
quantities exhibits diff'erent features according to the time scale which is consid- 
ered. For very long times, the walker can explore every site and its behaviour is 
described by the finite graphs laws introduced in the previous section. However, 
if the time is long enough to explore large portions of the system, but still too 
short to experience the finite size effects, many significant quantities arc quite 
insensitive to local details and exhibit power law time dependence with universal 
exponents. Often, this is the most interesting regime in physical applications. 
On infinite graphs, this is the true asymptotic regime even for very large times; 
therefore, we can reproduce the universal behaviours of a huge variety of finite 
large structures simply by considering infinite graphs with similar topological 
features. 

To deal with infinite graphs, some further mathematics has to be introduced. In 
particular, we need tools to "explore" large scale topology. To this purpose, we 

define the Generalized Van Hove Spheres (GVHS): a GVHS So.r of centre o and 
radius r is the subgraph of Q, given by the set of vertices T^j.r = {i & ^ki.o < r} 
and by the set of links Eg^r = € E\i e Vo,r,j S Vo,r}- 

Let us use \S\ to denote the number of elements of a set S. Then IVo.rl, as 
a function of the distance r, describes the growth rate of the graph at the 
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large scales 0]. In particular, a graph is said to have a polynomial growth if 
Vo € Vx 3c, fc, such that 

|V^o,r| < cr^ (45) 

For a graph satisfying we define the upper growth exponent dg and the 
lower growth exponent dg as 

d+ = inf{fc| \Vo,r\ < ci r^Vo G (46) 

and 

= sup{fc| > C2 r^Vo e 1/}. (47) 

If d'^ = dg , which usually happens on physically interesting structures, we call 
them the growth exponent dg, or the connectivity dimension. 
The connectivity dimension dg is known for a large class of graphs: on lattices, 
it coincides with the usual Euclidean dimension d, and for many fractals it has 
been exactly evaluated jSj. In general, we can think of it as the analogous of 
the fractal dimension, when the chemical distance metric is considered instead 
of the usual Euclidean metric. 

Infinite graphs are too general to describe systems of physical interest. In- 
deed, the discrete structures usually studied in physics are characterized by 
some important properties, often implicitly assumed in literature, which can be 
translated in mathematical requirements: 

A We consider only connected graphs, since any physical model on discon- 
nected structures can be reduced to the separate study of the models 
defined on each connected component and hence to the case of connected 
graphs. 

B Since physical interactions are always bounded, the coordination numbers 
Zi, representing the number of neighbours interacting with the site i, have 
to be bounded; i.e. 3zmax \ Zi < Zmax^i e V. 

C Real systems are always embedded in finite dimensional spaces. This 
constraint requires for the graph Q the conditions: 

(a) G has a polynomial growth (Definition I45|l 
(b) 

lim ^ = (48) 

where dVo^r denotes the border of Vo^r, i-e. the set of points of Vo,r 
not belonging to Vo,r-i (the existence itself of the limit is a physi- 
cal requirement on G). This condition is equivalent to require that 
boundary conditions are negligible in the thermodynamic limit. 

Notice that some graphs studied in physical literature, such as the Bethe 
lattice, do not satisfy (a) and (b) , while many random graphs do not fulfil 
B. 
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For a large class of physically interesting graphs we have considered so far, 
conditions (a) and (b) appear to be equivalent. However for the equivalence of 
the two conditions a rigorous result is still lacking. A graph satisfying A, B and 
C will be called physical graph. Conditions A and B represent strong constraints 
on Q and, as we will see later, they have very important consequences. 

7 Random walks on infinite graphs 

Considering random walks on infinite structures, some further mathematical 
constraints are to be introduced to describe physical situations. 
First of all, the problem of uniform boundedness comes into play. Indeed, in 
H14() the conditions 



together with B are usually required to exclude the presence of a global bias, 
which would generate a non-diffusive behaviour. 

Moreover, in (|15|l . in presence of waiting and traps, analogous considerations 
lead to the following conditions 

^Wmin,Wmax > \ either Wi=0, or Wmm < VOi<Wmax Vi (50) 

^drmn,dmax>^\ either = 0, or d™„ < < d„^ax Vi (51) 

In the case of finite graphs, the possibility of associating to any matrix an 
operator acting on a finite dimensional vector space allowed to obtain very 
general and rigorous results. In the infinite case, it is in general impossible to 
associate a linear operator acting on a Hilbert space to any matrix. However, 
when B holds, the jumping probabilities matrix is quite particular: indeed, it 
only has a limited number of non vanishing entries in each row and column. Due 
to this property, the elements of a matrix product are given by finite sums, as 
in the finite graphs case, instead of being sums of series. Therefore, the typical 
convergence problems of infinite dimension space do not arise, allowing for a 
simple and effective study of random walks properties. 

Despite the increased mathematical complexity, many general results about in- 
finite graphs have been rigorously proven. Some have correspondents in the 
finite graphs case, but most of them concern quantities and properties which 
cannot be even defined on finite structures. The rest of this section is devoted 
to the former: following the same format used in section 5 we resume the main 
differences with respect to the finite case. The new properties arising in the 
thermodynamic limit will be discussed in the following sections. 
First of all, let us consider random walks without traps on infinite graphs sat- 
isfying A.B. and ifSUI) . It can be shown that 




max 



(49) 



lOO 



fim [t) = 



(52) 
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even for bipartite graphs. However, for bipartite graphs without staying prob- 
abilities, we still have 

P,,(i)=0 (53) 

for all t such that t — Vij is odd. Therefore, to study the large times asymptotic 
behaviours, as in the finite case we usually consider, for any given couple of sites 
i and only the values t[j of t having the same parity as r-y. Unlike the finite 
case, the limit in (|52|l in general is not reached exponentially. Indeed, if C also 
holds, i.e. for physical graphs, the asymptotic behaviour is typically a power 
law, whose exponent only depends on topology, as we will discuss in details in 
the next sections. Notice that the widely studied case of Bethe lattices, not 
satisfying C, is still characterized by an exponential decay. 
Similarly, one can easily prove that 

limi^„(t)=0 V i,j (54) 

t—>c>o 

and 

\imS^it)=oo V i (55) 

t — ^oo 

the asymptotic behaviour being always bounded from above by t. 
As for the quantities concerning the number of visits and the first visit probabili- 
ties, the situation is far more complex. Indeed, dramatically different behaviours 
can occur, according to the graph topology. In particular 

Pij — CO V i,j or < oo V i,j (56) 

F^J = 1 V i,i or < 1 V I, J (57) 

and 

Uj < oo V i,j or =oo V «,j (58) 

The classification of infinite graphs according to these possible behaviours is the 
subject of the next section. 

8 Recurrence and transience: the type problem 

On finite graphs, in absence of traps, the probability of ever reaching (or return- 
ing to) a site, Fij, is always 1. This means that the walker surely visits each 
site. This probability can be lowered only by adding traps, but in this case the 
total probability is not conserved, i.e. the walker asymptotically disappears. On 
infinite graphs, a third possibility arises, which is expressed in (|5(j|) and (|57|) : 
the walker can escape forever from its starting point, or never reach a given site, 
even in absence of traps. 

This phenomenon was first noticed by Polya in 1921 on lattices: he showed 
that, while in 1 and 2 dimensions Fij — 1, for d > 3 Fij < 1 0- Since him, the 
former case has been called recurrent and the latter transient. Transience is an 
exclusive property of infinite graphs and it is fundamentally due to large scale 
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topology. In other words, in the transient case, it happens that the number 
of paths leading the walker away from its starting point is large enough, with 
respect to the number of returning paths, to act as an asymptotic trap (still 
conserving the total probability). 

As we will see in a while, transience and recurrence of random walks, when 
and are satisfied, only depend on the graph topology. Therefore they 
are intrinsic properties of a discrete structure and the classification of infinite 
graphs according to them is also known as the type problem. 
Let us define the problem mathematically. First of all, a very general theorem 
on Markov chains states the following: 

^^,J&G I F,,^l ^ Fhk^l yh,keg (59) 

this means that recurrence is point independent, or, in other words, that if a 
walker surely reaches a point j starting from a given point i, then it surely 
reaches any point k starting from any point h. It is straightforward to see that 
an analogous result follows for the case < 1. Therefore, recurrence and 
transience are global properties of a random walk. 

Another important result relates and Pij. Indeed, from (|23|l . H24|) . and (|2(j|) . 
it follows that 

Fy - 1 ^ P^J^(X, (60) 

and 

F,j < 1 <^ Pij <oo (61) 

i.e., a walk is recurrent (transient) if and only if any site is visited an infinite 
(finite) number of times. The latter can be taken as an alternative definition 
of recurrence and transience. However, as we will see, the situation is more 
complex when considering averages over all the sites. A consequent property 
concerns the way the walker explores the sites of Q. Indeed, it can be shown 
that 

= 1 ^ lim ^ = (62) 

while 

F,,<1 ^ < lim ^ < 1 (63) 

In the first situation, where the number of distinct visited sites increases slower 
than the number of steps, is sometimes called compact exploration^ since the 
subgraphs of the visited sites presents a negligible number of " holes" . 
Recurrent graphs exhibit a further relevant property: one can show that 

lini ^ lim = ^ Vz,j,/i,fc (64) 

The most important properties in the type problem concern its invariance with 
respect to a wide class of dynamical and topological transformations, establish- 
ing its independence of the graph details. 
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First of all, consider two different random walks (without traps) on the same 
graph Q, one (W) defined by the ferromagnetic coupling matrix and by the 
waiting probabilities Wi, and one (W) by J^j and w'^ . It can be shown [7] 
that, if both satisfy H49|l and H5U|) . then W is recurrent if and only if W is. In 
other words, any local bounded rescaling of ferromagnetic couplings and waiting 
probabilities leaves the random walk type unchanged. Therefore, provided the 
previously mentioned boundedness conditions are satisfied, the walk type only 
depends on the graph topology. 

Moreover, even the local topological details are irrelevant to determine the type 
of a graph. Indeed, it is possible to show that recurrence and transience are left 
invariant by adding and cutting of links satisfying the quasi-isometry conditions. 
More precisely, two graphs G and G' are called quasi-isometric if there are a 
mapping (p : G ^ G' and constants A > 0, B > such that 

for all i,j G G, and 
for every i' € G' ■ 

If B = then we say that G and G' are metrically equivalent. Quasi-isometries 
can be defined between arbitrary metric spaces and represent the most general 
local topology deformations. Typical examples of them are given by the decima- 
tion transformations used on fractals and in real-space renormalization. In some 
sense, we can consider quasi-isometries as their extension to general networks. 
All the results presented so far refer to random walks without traps, i.e. to 
jumping probabilities given by (|15(l with di — 0. The introduction of at least 
one trap, setting > for at least one site i, has a very general and simple 
influence on the random walk behaviour: indeed transience is left unchanged, 
while recurrent random walks always become transient. 

9 The local spectral dimension 

As well as it happens for recurrence and transience properties, large scale topol- 
ogy affects the long time dependence of random walks quantities on infinite 
graphs. Indeed, it has been known for many years that, on regular (translation 
invariant) lattices, the exponents of the asymptotic power laws of random walks 
only depend on the lattice (Euclidean) dimension d. For example, 

Puit) --^ t-"^'^ for t-^oo, \/i (65) 

and 

S',(t) foj. t^oo, Vi, for d^2 (66) 

(while, for d — 2, Si{t) ~ t/\nt). As we mentioned before, these laws typically 
present power behaviour even on general physical graphs, and the exponents of 
such powers can be used to define a generalized dimension. 
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Let us consider a random walk without waitings and traps satisfying (|49l) . and 
suppose that, for a given i ^ Q 

Pu{t) ^ r'^/'^ for t^oo (67) 

then it can be shown that 

Phkit) ^ t-"^^^ for t-^oo, Wh,k (68) 

(for bipartite graphs, the usual assumptions on the parity t are understood). 
This means that the exponent of the power law is site independent and, there- 
fore, it is a parameter characterizing the whole random walk. Since c? = d on 
regular lattice, we can consider it as a dimension associated to the random walk 
on Q. More precisely, we shall call local spectral dimension the limit 

d = -2 hm ^ 

t^oo int 

when it exists. 

Notice that the existence of this limit for a given i implies it exists and has 
the same value for any j £ Q. Moreover the definition given in (|69|l is more 
general than H()7|l . since it includes the case of possible multiplicative correction 
to the asymptotic behaviour, provided they are slower than any power law (e.g. 
logarithmic corrections). 

^From an historical point of view, the term "spectral dimension" was first intro- 
duced by Alexander and Orbach in 1982 [H], studying the anomalous vibrational 
dynamics on fractals. In the same work, they suggested that even the random 
walks should be ruled by the same parameter and wrote eq. H67() . Then the 
definition was generalized to general networks by Hattori, Hattori and Watan- 
abe jni- Later, it has been shown that the anomalous dimension involved in 
vibrational dynamics is the average spectral dimension ( 10 ), we shall discuss 
in further sections, which coincides with d only for particular graphs, such as 
exactly deciniable fractals. 

As for the existence of the limit (|69|l , a general theorem is still lacking, but it 
can be easily proven that the asymptotic decay of Pa (t) is always bounded from 
above and from below by power laws. In any case, on all known cases of random 
walks on physical graphs, the local spectral dimension has been shown to exist. 
Notice that for the Bethe lattice, which does not fulfil the polynomial growth 
condition, the limit 169(1 is infinite. ^From now on, we shall consider random 
walks on graphs where d is defined. Then, one can easily derive the following 
results: 

• Random walks are recurrent if d < 2 and transient if c? > 2. For d = 2, if 
(|67() holds, random walks are recurrent. However, subleading corrections 
to the power law can change the type to transient. 

• When (EH) holds, 

S',(i) - i™"^!''*/^) foj. i^oo, Vi, for d^2 (70) 
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(69) 



otherwise, in general, 



lim '\ ' ^ min{l,d/2) Vi, for d^2 (71) 

t^oo Ini 

• When (EH) holds, 

i^^jW ~ i"""'''^^"^'"''^^^ for t^oo, for d 7^ 2 (72) 

otherwise, in general, 

lim i^^^^ = TOm((i/2 - 2, -d/2) Vi,j for d 7^ 2 (73) 

The case d = 2 is rather particular. Indeed d = 2 is a critical dimension 
for random walks, discriminating recurrence from transience. The a^mptotic 
behaviours of Si{t) and Fij{t) have a different dependence on d for d < 2 and 
d > 2. In particular, the probability of first visit has the same time decay of Pij 
for d > 2 while it decays faster for d < 2. When d = 2, the behaviours of Si{t) 
and Fij{t) are strongly affected by subleading corrections. 

As for the type problem, local spectral dimension presents interesting invariance 
properties. First of all, it can be shown that waitings satisfying H50|l do not 
affect its value jJOl- Moreover, for d < 2, on a given Q it is the same for all 
ferromagnetic couplings satisfying 0. Unfortunately, an analogous result 
has not been proven for d > 2. However, we will see in later sections that the 
average spectral dimension has also this universality property. 
The introduction of a finite number of traps do not^ affect difd>2. Ifd<2 
a finite number of traps (even only one) changes d to d + 1. If the traps are 
infinite the behaviour is more complex and depends on their distribution. 



10 Averages on infinite graphs 

Usually, infinite graphs describing real systems are inhomogeneous, i.e., in math- 
ematical terms, they are not invariant with respect to a transitive symmetry 
group. In simpler words, this means that the topology is seen in a different 
way from every site. The main effect of inhomogeneity is that the numerical 
values of physical quantities are site dependent. Therefore, one is typically inter- 
ested in taking averages over all sites. This requires the introduction of suitable 
mathematical tools. 

First of all, the average in the thermodynamic limit (/) of a function defined 
on each site i of the infinite graph Q is defined by: 

E 

^= lim '^^"Z" . (74) 

r~*oo l\o.r 
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The measure \S\ of a subset S' of is the average value x{S) of its characteristic 
function Xi{S) defined by Xi{S) = liii & S and XiiS) — Oifi ^ S. The measure 
of a subset of Unks E' C E is given by: 

\E'\ ^ Urn . (75) 

where E'^, is the number of Unks of E' contained in the sphere 5*0, r- The nor- 
mahzed trace Tr_B of a matrix Bij is: 

Tf B = 6 (76) 

where bi = Ba. If condition C holds, then we can prove ^2 that the averages 
of a bounded from below function <j)i are independent from the centre o of the 
spheres sequence, using the fact that Xi{S) is bounded and that measures of 
subsets are always well defined. 

Now, due to this site independence, we have a good definition of averages which 
we will use in dealing with properties of random walks on infinite graphs. As 
we shall see in the next section, on inhomogeneous networks the averages of 
site dependent functions can have a very different behaviour from their local 
counterparts, giving rise to rather unexpected phenomena. 



11 The type problem on the average 

In the last few years it has become clear that bulk properties are affected by 
the average values of random walks return probabilities over all starting sites: 
this is the case for spontaneous breaking of continuous symmetries 11 , critical 
exponents of the spherical model ^Sli harmonic vibrational spectra [HS- There- 
fore the classification of discrete structure in terms of recurrence on the average 
and transience on ttie average appears to be the most suitable. Unfortunately, 
while for regular lattices the two classifications are equivalent, on more general 
networks they can be different and one has to study a Type-Problem on the 
Average 

This is defined using the return probabilities on the average P and F, which 
are given by: 

P = lim P{\) = lim_ TYP(A) (77) 



F = \im_ F(A) = ^hm_ TrF(A) (78) 

A graph Q is called recurrent on the average (ROA) if _F = 1 , while it is transient 
on the average (TO A) when F < 1. 

Recurrence and transience on the average are in general independent of the 
corresponding local properties. The first example of this phenomenon occurring 
on inhomogeneous structures was found in a class of infinite trees called NTD 
(see sect. 113. 3f) which are locally transient but recurrent on the average 
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Moreover, while for local probabilities (|26|l gives: 

PniX)Fu{X)Pu{X) + 1 (79) 

an analogous relation for (|78|l and H77I) does not hold since averaging H79|l over 
all sites i would involves the average of a product, which due to correlations 
is in general different from the product of the average. Therefore the double 
implication Fi{l) ~ 1 <^ limA-+i Pi{X) = cxd is not true. Indeed there are graphs 
for which F < 1 but P — oo (an example is shown in Fig.l) and the study of 
the relation between P and F is a non trivial problem. 

A detailed study of this relation flS shows that a complete picture of the be- 
haviour of random walks on graphs can be given by dividing transient on the 
average graphs into two further classes, which are called pure and mixed tran- 
sient on the average (TOA). 

First, considering a ROA graph, it can be proven that if F = 1 then P = oo. The 
proof can be easily generalized to graphs in which there is a positive measure 

subset S such that: limA-»i x{S)F{X) — \S\. Indeed in an analogous way it can 
be proven that: 

P > Yiinx{S')P{X) = oo VS" C S, \S'\ > (80) 

We call mixed transient on the average a TOA graph having a positive measure 

subset S such that: 

limx(5)i^(A) = |5|. (81) 

while a graph is called pure TOA, if: 

lim^x('5')^(A) < IS"! VS-cy, |S'|>0 (82) 

Examples of pure TOA graphs are all the d— dimensional cubic lattices with 
d > 2, while the "haired cube" of Fig.l is a typical mixed TOA graph. Notice 
that a relevant theorem establishes that for mixed TOA graphs we have 
P = oo, while for pure TOA graphs P is finite. A further important property, 
characterizing mixed TOA graphs, allows simplifying the study of statistical 
models on these very inhomogeneous structures. It can be shown (13| that, in 
this case, the graph Q can be always decomposed in a pure TOA subgraph S 
and a ROA subgraph S with independent jumping probabilities by cutting a 
zero measure set of links dS = G E\i g Sj G S}. The separability prop- 

erty implies that the two subgraphs are statistically independent and that their 
thermodynamic properties can be studied separately. Indeed, in the thermo- 
dynamic limit, the partition functions referring to the two subgraphs factorize 

m 

To conclude this section, we note that the same invariance properties of the 
local type problem under addition of waiting probabilities, coupling rescaling 
and quasi-isometries still hold for the type problem on the average. This means, 
as for the local case, that recurrence and transience on the average are intrinsic 
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properties of a graph and not only of a specific random walk defined on it. On 
the other hand, the introduction of a finite number of traps does not change 
the type on the average. Notice also that a slightly different definition of the 
type problem on the average can be found in mathematical literature it is 
more convenient for the formal development of the theory, but it is not directly 
related to statistical models on graphs. 



12 The average spectral dimension 

The asymptotic time dependence of the return probability on the average can 
be used to define a new intrinsic dimension which turns out to be very strictly 
related to the physical behaviour of statistical models on graphs ^1 ^1 EI i as 
we will briefly discuss in the last section. 

Indeed, even if the asymptotic time decay of Pii{t) is always the same for all 
sites i, when the graph topology is strongly inhomogeneous it happens that 
its average over all the sites decays according to a different law. The average 
spectral dimension d is defined for physical graphs, like the local one in H67I) and 
®,by 

P{t) - i"''/^ for t^oo (83) 

when the asymptotic behaviour is a power law without subleading corrections, 
or, more generally, by 

J^_2 1inii^^. (84) 

t^oo \nt ^ ' 

Notice, however, that, differently from the local case, no physical graphs are 
known, up to now, where the long time decay is not given by H83(l . Consid- 
erations analogous to those presented for the local case hold here, concerning 
the existence of the limit (|84|) . Obviously, in all cases where the local type is 
different from the average type, also the local spectral dimension differs from 
the average spectral dimension. A typical example, and, historically, the first 
one, is given again by NTD (see sect. 113.3(1 for a detailed account). However, 
the relations between d and the type problem on the average are not the same 
as in the local case. Indeed, while if c? > 2 the walk is always pure TOA, random 
walks with d < 2 can be either pure ROA or mixed TOA. 

The most relevant property of d is without any doubt its strong invariance 
with respect to a very large class of dynamical and topological transformations, 
making it a unique universal parameter associated to a graph Q |l()l I18| . 
These transformations can be divided into three main classes: 

1. Dynamical transformations leaving the graph topology unchanged. These 
consist in addition of waitings and of a finite number of traps, as well as 
in bounded local rescaling of ferromagnetic couplings. 

2. Topological transformations modifying the number of links but leaving the 
sites unchanged. These include "addition transformations" and "cutting 
transformations" . The additions transforms consist in adding links joining 
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sites up to an arbitrary but finite chemical distance from any site, while 
the cutting transform are defined to be their inverse. The most general 
transformations consist in a combination of addition and cutting. Notice 
that even an infinite number of links can be modified with respect to the 
original graph. 

3. Topological rescaling, i.e. topological transformations modifying both links 
and sites. The most general topological rescaling can be realized through 
two independent steps. The first one is the partition and consists in di- 
viding the graph Q in an infinite family of connected subgraphs Qa, with 
uniformly bounded number of points. The second one is the substitution 
and consists in generating a new graph Q' by replacing some or all Qa by a 
different (connected) graph Sa, whose number of points ranges from 1 to 
a fixed N^ax, and by adding links connecting different Sa in such a way 
that two generic Sa and Sp are connected by some links if and only if Qa 
and Gp were. The simplest topological rescaling occurs when every Sa is 
composed by just one point. In this case the resulting graph G-^^ is called 
the minimal structure of the partition {^Jq}. 

These three very general classes of geometrical transformations (together with 
even more general ones violating conditions B and C and therefore not discussed 
here can be applied in all possible sequences to a graph, leading to an 
overall transformation on coupling strength, number of links and degrees of 
freedom which does not change its spectral dimension d. We will call such a 
transformation an isospectrality . 

Notice that isospectralities include quasi-isometries as a particular case. Indeed, 
isospectralities include most part of currently used transformations. 
As an example, the usual decimation procedure on fractals is a topological 
rescaling. In particular, for all exactly decimable fractals (such as e.g. Sierpinski 
gaskets and T- fractals, as discussed in the next sections), the minimal structure 
of the graph coincides with the graph itself. Again, an isospectrality relates the 
usual two dimensional square lattice, the hexagonal lattice and the triangular 
lattice, which therefore all have dimension 2. In other words, isospectralities 
are the theoretical formalization of the intuitive idea of invariance with respect 
to bounded scale perturbations and disorder and the isospectrality classes, de- 
fined as the classes of graphs related by such transformations, are the practical 
realization of the apparently abstract concept of non integer dimension. 
Now, since most dynamical and thermodynamical properties of generic discrete 
structures depend only on d, isospectralities provide a very powerful tool to 
reduce a very complicated geometrical structure to the simplest one having the 
same d. The latter turns out to be much simpler to study and still presents the 
same universal properties. 

Moreover, not only an isospectrality can be used to reduce and simplify struc- 
tures and problems. It can also be applied, with the opposite aim, to build com- 
plicated structures with controlled dynamical and thermodynamical properties, 
starting from simple deterministic geometrical models. This is the point of view 
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of spectral dimension engineering, providing a very interesting field of possibil- 
ities to polymer physicists and material scientists dealing with non-crystalline 
materials. In Fig. 2 we give explicit examples of isospectral structures obtained 
applying isospectral transformations (without long range couplings) to the T- 
fractal and to the square lattice. 

On macroscopically inhomogeneous graphs, it can happen that the average value 
of Pa (t) on infinite subgraphs of G with positive measure decays with a power 
law different from (|83|l |19| . In such cases, it is interesting to look for the 
maximal (positive-measure) subgraphs having no (positive measure) parts with 
different power law decay. These are called spectral classes and each is charac- 
terized by its own spectral dimension. A theorem rather relevant in physical 
applications establishes that spectral classes can be separated from each other by 
cutting a zero-measure set of links, implying the same statistical independence 
property we discussed for mixed TOA graphs 

13 A survey of analytical results on specific net- 
works 

Apart from the well known case of regular lattices, where it is completely solved 
|2()| . the random walk problem has been studied analytically only on some 
specific classes of infinite graphs. In these cases, one usually focuses on the 
asymptotic properties of random walks autocorrelation functions and on the 
calculation of the local and average spectral dimension. As we discussed in the 
previous sections, these are the most important quantities in statistical physics 
and thermodynamics. On lattices, the random walk problem is solved by using 
the translation invariance of the structure, and this allows applying powerful 
mathematical tools, such as the Fourier transform. On general graphs these 
methods do not apply. Therefore due to the lack of translation invariance, one 
has to introduce new and alternative techniques, which can be grouped in three 
main classes: renormalization techniques, combinatorial techniques and mixed 
techniques. In the next subsections we will review recent and significant results 
obtained with these techniques. 

13.1 Renormalization techniques 

Renormalization techniques have been successfully applied on deterministic frac- 
tals networks, where one can take advantage of the decimation transformations 
which connect two consecutive generations. In particular, a well studied class of 
fractals is that of exactly decimable fractals. On these structures, exact renor- 
malization group calculations based on a real space decimation procedure allow 
obtaining all the relevant random walks quantities. 

Let us consider a random walk without traps and sources defined by the jumping 
probabilities and let us write the master equation for the probability Poi of 
being at site i after t steps for a random walker starting from an origin site 
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at time 0: 

Po.(i + 1) - Po,(<) = J2Ao,{^^ ~ + 6.o6to (85) 

Equation (|85|) can be written in terms of the generating function (A) when 
A — > 1~ by setting A = 1 — e, writing: 

oc 

hA^)^Y.^l + e)-'nAt) (86) 
t=o 

and taking e s- 0: 



eFo,(e) = A.A^ " ^) + -^o. (87) 

Zj ^2 

Notice that the system (|57|) is inhomogeneous and corresponds to a Cauchy 
problem, which has only one solution. The behaviour of such solution for e — > 
is what we need to obtain the local spectral dimension d, as defined in (|57|l . 
through the Tauberian Theorems. On the other hand, to calculate the average 
spectral dimension d we will need to average over all starting points the solution 
of equation (|87|l , strongly modifying its asymptotic behaviour on inhomogeneous 
graphs, as we will see in the following. 

Exactly decimable fractals are a restricted class of self similar structures (i.e. 
not all self similar structures are exactly decimable) which are geometrically in- 
variant under site decimation. This invariance is explicitly applied in analytical 
calculations for random walks. A geometrical structure is decimation invariant 
if it is possible to eliminate a subset of points (and all the bonds connecting these 
points) obtaining a network with the same geometry of the starting one. /,From 
a mathematical point of view this corresponds to the possibility of eliminating 
by substitution a set of equations from system (|85|) or H87|) obtaining a system 
which is similar to the initial one after a suitable redefinition of the coupling 
parameters. Examples of exactly decimable fractals are the Sierpinski Gasket 
(Fig.3), ESlEniETIEHl, the T-fractal, shown in Fig.4 [211301, the branched 
Koch curves, in Fig. 5 |31| . In general, all deterministic finitely-ramified frac- 
tals are exactly decimable. Notice that exact decimation is a particular case of 
isospectrality, as we discussed in previous sections. 

Let us consider now the general procedure to decimate the set of equation (|85() . 
After eliminating a set of points and substituting the corresponding equation, 
one finds: 

e ^ e'(e) ~ a^e (88) 

The presence of the term 5iQ in H87I) requires a redefinition of the quantities Pij (e) 
to assure that, even after the decimation, the initial condition will correspond 
to the probability of being in a fixed site equal to 1. One introduces a new 
parameter c and writes the transformation law for Pij (e) as: 

p,^(6)^i^^(6')^ip.,(6) (89) 



24 



From the rescaling of e and (e) , the local spectral dimension d is obtained by 
using a suitable expression for Poo(e): 

which holds only for d < 2. This is always the case for exactly decimable 
fractals. Using expression (|90|l one easily finds: 

d = 2'f^ (91) 
log 

As for the average spectral dimension d , by using the relation between equation 
H87|) and the equation for harmonic oscillations to be discussed later one 
has that 

d^'i^ (92) 
log a 

where r is the decimation ratio used in the renormalization procedure. Therefore 
d = J if 

r = a^/c (93) 

This can be shown to be the case for all exactly decimable fractals, using results 
obtained ^ for the Gaussian model. 

Equation H92|l allows calculating the spectral dimension on all exactly decimable 
fractals, once the decimation procedure is identified, recovering known results. 
One of the most studied fractal is without any doubt the Sierpinski gasket 
|25l I26L [Tzl I28| and its generalizations. For the simplest case one has r — 3 and 
a ~ \/5, leading to: 

d=2p^ (94) 
log5 ^ ^ 

For d-dimensional generalized Sierpinski gaskets, which are built from a 
dimensional hypertetrahedron of side length b filled with b layers of smaller 
hypertetrahedra of unit site length, Hilfer and Blumen |26| have shown that for 
6=2 

~ log d + 1 , , 

d=2 95) 

logd + 3 ^ ^ 

and for 6 = 3 

d = 2 log((^+l)(rf + 2)/2) 

log((d + 2)(2d2+9d+19)/(4d+6)) ^ ' 

Due to the self-similarity of the structure, the return probabilities on the Sier- 
pinski gasket show a remarkable effect, which has been pointed out in |32|. 
Indeed, the coefficients have an oscillatory behaviour, which is given by: 

^oo(t)-i-^/^P(|g) (97) 
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where is a periodic C°°-function of period 1 whose Fourier series is given by 
Fix)= J2 r{l~-^ + --)-'exp{2nHx) 98 

k — — OG 

Interestingly, it can be shown that the oscillation of the coefficients disappears 
in the probability of return on the average. 

The renormalization techniques can be applied to all exactly decimable fractals. 
For example, for the T— fractal |2HI2n|j which is a particular case of hierarchical 
combs ■ one has r = 3 and a = \/6. 

13.2 Combinatorial techniques 

Renormalization procedures cannot be applied on non self-similar graphs. There- 
fore one has to develop alternative techniques to study the random walk prob- 
lem. This is the case of bundled structures [2211131! a large class of very inter- 
esting graphs used in condensed matter as realistic models for the geometry and 
dynamics of polymers and other inhomogeneous systems. Given two graphs B 
and T , not necessarily different, and a site F of , we call bundled graph with 
base B and fibre T the graph built by joining to each site of S a copy of in 
such a way that F is the only site B and J- have in common (Fig. 6). Examples 
of bundled structures are comb polymers |34| (Fig. 7), brush polymers, shown 
in Fig. 8, and many kinds of branched aggregates (Fig. 9). For these graphs a 
purely combinatorial technique allows calculating of the asymptotic properties 
of the random walk autocorrelation functions. 

Let us consider a walker starting from a point belonging to the base and let 
us restrict ourselves to base graphs with constant coordination number zg. By 
decomposing the motion of the walker on the fibre and on the base, one can 
obtain: 

(99) 

where P' refers to a random walk on T with a trap in the starting point of T . 
In terms of the generating functions equation, l|99|l becomes: 

Po(A) = £ P,(iJ f^^)'' fe(A))*"^' = P;(A)PJA') (100) 

with 

A'--^n(A) (101) 

and 
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with (A) being the generating function of the probabiHty of returning to the 
starting point F on T without the trap. From this relations one obtains the 
values for the local spectral dimension on general bundled graphs: 



d= < 



dp if > 2 



4 - if < 2 e > 4 

dp+d^~ if 4 < 2 e d^ < 4 



(103) 



where dg and d^ are the local spectral dimension of the base and of the fibre. If 
the coordination number of the base is not constant, it can be shown that this 
amounts to introduce waiting probabilities on the points connecting the fibre 
and the base, which, as shown in the previous section, does not change the value 
of the spectral dimension. 

As for the average spectral dimension, it is easy to show that if the fibre is an 
infinite graph, the average spectral dimension of the whole graph is the spectral 
dimension of the fibre. On the other hand, if the fibre is a finite graph, the 
average spectral dimension coincides with that of the base. 
^From equations (|100|l , (|102|l one also obtains the asymptotic laws for the prob- 
ability of returning to the starting point, which on these structures can contain 
logarithmic corrections. Indeed, writing 



1=0 



and setting 
and 



m = mm 



{z>0|/3(*)^-l} 



( dl2 \ = < -'^ '^/^ integer 
V / Inn 



otherwise 



one has: 

a) if de < 4 and djr <2 

-1 



2 



(104) 

(105) 
(106) 



for < i < 



for i ~ 



otherwise 



(107) 

where mg and refers to the base and to the fibre respectively while m refers 
to the whole graph and is determined by: 



m = m + 5~ rrig 



(108) 
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b) if > 4 and dyr < 2 



c) if = 4 and djr < 2 and rfg > — 1 



^^(i)-2(5,,„^/(d^/2) forz>m^ 

for < i < m. 



(109) 



has to be determined as in a). 

d) if (ig = 4 and djr < 2 e mg < — 1 
(3{i) has to be determined as in b). 

e) if > 2 

Pii)=f3,{i) (110) 

The case djr = 2 has to be treated separately, as the case djr < 2 if the fibre is 
a recurrent graph or as the case djF > 2 if it is transient. 

Another interesting way of combining together two graphs to obtain a more com- 
plex structure is the Cartesian product. The Cartesian product of two graphs 
X, Y has vertex set X x Y, and two pairs xy, x'y' are adjacent if a: ~ and 
y = y' , ov X — x' and y ^ y' ■ An example of an interesting Cartesian product 
is that of the Toblerone graph [HI], shown in Fig. 10, which is obtained from 
the product of a line with a Sierpinski gasket. Using combinatorial techniques 
analogous to those presented for bundled graphs, it can be show that the lo- 
cal and the average spectral dimension on the whole graph are the sum of the 
corresponding dimensions of the two initial graphs [7] . 



13.3 Mixed techniques 

The random walk problem on some very interesting cases of graphs cannot be 
studied simply by one of the above cited techniques and it requires instead a 
"mixed" use of the two, which gives rise to very interesting phenomena. Indeed, 
the first example of a difference between the local and the average spectral 
dimension, the "dynamical dimension splitting" , was observed on the quasi self- 
similar graphs NTd, where the asymptotic properties of the random walk were 
found by a mixed technique [Tl] . 

The fractal trees known as NTd [1^1 can be recursively defined as follows: an 
origin point O (Fig. 11) is connected to a point 1 by a link, of unitary length; 
from 1, the tree splits in k branches of length 2 (i.e. consisting of two consecutive 
links); the ends of these branches split in k branches of length 4 and so on; each 
endpoint of a branch of length 2" splits in k branches of length 2"+^. 
As one can easily verify, A^Tq are not exactly decimable and therefore the 
simple decimation techniques cite above cannot be applied. Indeed, after a 
simple decimation starting from the origin O, one obtains k copies of the original 
structure joined together in a point instead of the same NTo- However, NTd 
are invariant under a more complex transformation T = D ■ C , consisting of the 
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product of a cutting transform C and a decimation D, that can be described as 
follows. Let us cut the log of the tree in point 1 and separate the k branches 
(cutting transform). Now, each branch can be obtained from the initial NTd by 
a dilatation with a factor 2. Eliminating all branches but one and decimating 
it (decimation transform), one obtains the original NTjj. 

The T transform can now be used to solve the random walks problem. Let 
us sketch the main points of the calculation. The cutting transform gives a 
relation between random walks on the whole tree and random walks on one 
of its branches; more precisely one relates Pq^'^{X), the generating function of 
the probability of returning to point O after a random walk on the NTo tree, 
and /^'"'''"'^''(A), the generating function of the probability of returning to the 
starting point 1 after a random walk on one of the branches. This relation is 
given by [T^ : 

pbranch ( \ \ i j, 

P*--(A) = -14 ^ (111) 

Now, the decimation transformation is performed using a time-rescaling tech- 
nique. Indeed, the motion of the random walker on the branch considered only 
after an even number of steps can be exactly mapped in the motion of a random 
walker on the tree after the introduction of a staying probability = 1/2 in 
every site i. This equivalence can be translated in terms of generating functions 
through the substitutions: 

Po(A)->^Po(^) (112) 

A -> A2 (113) 
Equations (|112|l and (|113|l can be used to rewrite Hlll|) as: 

2 tree f \^ \ 

~ tree 2^ ( 2^ ) + ^ 

Po (A) = 2 / \^ \ ^^1^) 

Choosing a suitable power law expression for the singularity of Pqo^W fo'" 
A ^ 1~ 25 we obtain: 

To obtain the average spectral dimension, one has to calculate the normalized 

— - tree — 

trace of the return probability Pq (A). It can be shown that d — 1 and this 
can be intuitively understood noting that the topology of NTjj is dominated 
by linear chains which become longer and longer in the outer branches |21| . 
Therefore, while NTu are locally transient if the ramification k is greater that 
2, they are always recurrent on the average. This result has been generalized. 
Indeed, recently it has been shown that all physical trees, satisfying conditions 
A, B and C are recurrent on the average |37| . 
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The cutting decimation transform can be applied to a large class of non-exactly 
decimable fractals which correspond to more general cases of the NTo- This 
are built with the same recurrence procedure as the NTd and we shall call them 
2^ NTo, nNTrt and p — polygonNTo, depending on the growth rules for the 
branches |24j . 

The first generalization is that of 2"' NTd- The 2"' NTd are infinite fractal 
trees that can be recursively built using the same recipe as for NTd but, from 
point 1, the log splits in k branches of length 2™ (i.e. made of 2™ consecutive 
links) which, in turn, split in k branches of length 2^*" and so on in such a way 
that each branch of length 2"™ splits in k branches of length 2^"+^)™. The 
case m = 1 corresponds to the usual NTd previously studied. If m > 1 the 
time rescaling procedure which led to (|112|l and (|113|l must be iterated m times 
obtaining: 

(i-A2)(nr=i2^)^o (A.+i)+fc 

with 

A,; = 



A i^l 



i > 1 



i being the iteration step. This gives, with the same steps as for m = 1: 

(117) 

which represent the generalization of the result obtained for m = 1. 
The previous results can be extended to nNTo, where now n is an integer and 
not necessarily a power of 2, and to p — polygonNTo, where the branches of 
NTo are replaced by p- vertices regular polygons (Fig. 12). 

Let us consider nNTo first. While relation Hlll|) for the cutting transform still 
holds, the exact time-rescaling procedure can not be applied to the branch of 
generic length n. However even in this case it is possible to obtain an asymp- 
totic recursion relation applying the Renormalization Group techniques usually 
implemented on exactly decimable fractals. Although this procedure cannot 

give an exact equation for Pq (A) as in the previous case, nevertheless it can 
be used to obtain the exact value of d via an asymptotic estimation. 
Indeed, in this case the branch of the nNTo can be considered as a tree with 
a dilatation factor equal to n. The log of this tree can be reduced to a unitary 
length log after the suppression of the n — 2 sites between the edges and intro- 
ducing a new link connecting the edges. The same operation can be repeated for 
branches of every length suppressing the inner n — 2 consecutive sites in every 
sequence of n sites and introducing a new link between the surviving points. 
The final structure is equal to the original tree and the generating function 
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-^--branch -^--'branch 

Pi (A) becomes Pi (A ) where: 

\'=n^X (118) 

bra7ich , 1 —-branch 

Pi (A')- -A (A) (119) 

n 

'branch — - tree 

Now Pi (A') coincides with Pq (A') since our branch has been trans- 

formed into a tree and Hlll() can be rewritten as: 

2\nPo (n2A) + k 

Using the procedure described in the previous section for 2™A^Td, from (|120|l 
it foUows that for an n — NTb the spectral dimension is given by: 

d„ = l + }^ (121) 
In n 

An anafogous technique can be used for p — polygonNTjj (Fig. 12). The fog 
polygon has now p faces of unitary length; from each of p — 1 of its vertices k 
polygons depart, whose faces have length n and so on. These structures, though 
similar to NTd are no longer loopless structures nor necessarily bipartite graphs 
(e.g. the i—polygon tree). The Cutting-Decimation transform can be applied 
to p — polygonNTjj as in the case of NTjj with the same substitutions (|118|l 
and H119|) . Indeed, even if Hlll|) does not hold in this case, a new relation 
between the generating functions of the tree and that of one of its branches 
can be obtained using bundled structures theory discussed above L^t us 

consider a p — polygonNTi:i and suppose to attach k branches also in the free 
vertex of the log (the root of the tree): we obtain a bundled structure having 
the log polygon as base and the graph made of k branches as fibre. Since for a 
p-polygon: 

PoiX) - ^ (122) 
as A ^ 1, we obtain for our bundled structure: 



^'^^ J -—branch n \ ^ j_ 1 » —branch I ("^^^) 

~b.s 

where Pq (A) is the generating function of the probability of returning to 
point O (one of the vertices of the log polygon) after a random walk on the 

- — branch 

bundled structure and Fi (A) is the generating function of the probability 
of returning for the first time to the point of connection with the base after a 
random walk on the fibre. Now, 

— b.s. k — -branch 1 tree 

Fo (A) = ^— Fi (A) + ^— Fo (A) (124) 
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where Fq'^'''''' {X) refers to the p - polygonNTo- From (jHSl, and ^(TT^ and 

— 'branch — -branch 

using the usual relation between Fi (A) and Pi (A), a relation be- 

- — tree - — branch 

tween Pq (A) and Pi (A) follows, which represents the cutting trans- 
formation. It is now possible to perform the Cutting-Decimation transform to 
p—polygonNTo and get: 

d, = l + i^ifc^ (125) 
inn 

In the same way we can calculate the spectral dimension of an NTo built with 
d— dimensional simplexes instead of p^polygons. A d-dimensional simplex is a 
complete graph of d+ 1 points i.e. a graph where each point is nearest neighbour 
of all other points. The 2— dimensional case is the triangle, the 3— dimensional 
one is the tetrahedron and so on. Since for d— simplex PqW ^ l/{d+l)(l~ X) 
the spectral dimension is: 

T , Inkd 

dd = l + 126 

inn 

14 Relation with other physical problems 

As we have shown in previous chapters, the random walk problem is strictly 
related to graph topology. Indeed, the main physical quantities are simple 
functions of the adjacency matrix A, which algebraically describes the graph 
structure. Now, the Hamiltonians of a series of fundamental statistical models 
are linear in A, therefore even their behaviour is deeply influenced by topology 
and it can be expressed in terms of random walks functions. Due to this rea- 
son, the main concepts and parameters characterizing random walks, such as 
recurrence and transience, as well as the spectral dimension, determine also the 
properties of these models, which have very different physical origins. This pro- 
vides a very powerful tool to investigate and classify geometrically disordered 
and inhomogeneous systems, where the usual techniques and ideas developed 
for lattices do not apply. 



14.1 The oscillating network 

Probably, the physical model whose connection with random walks has been 
most extensively explored is the so-called oscillating network. 
The harmonic oscillations of a generic network of masses m linked by springs 
of elastic constant K can be studied by writing the equations of motion of the 
displacements Xi of each mass from its equilibrium position: 

m— = ~K^^Aij{xi - Xj) = -K^^AijXj (127) 

j 3 

which after Fourier transforming with respect to the time reads: 

-2ii = ^Ayij (128) 
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where ujq = K/m. In other words, the determination of the normal modes and of 
the normal frequencies of the oscillating network reduces to the diagonalization 
of the Laplacian operator 5. 

Noticing that A = Z{1 — P), where 1 the identity matrix and P is given by 
(0}, it is not difficult to establish mathematical correspondences with random 
walks. In particular, using the universality properties discussed in the previous 
sections, one can show a fundamental result concerning the density p{uj) of 
normal modes at low frequencies: 

- uj^^'^ for Lj^O (129) 

This basic connection between random walks and harmonic oscillations was first 
introduced by Alexander and Orbach in 1982 for the case of fractals. Notice 
that at that time the splitting between local and average spectral dimension 
on inhomogeneous structures was not yet known and the exponent describing 
the scaling of the density of states at low frequencies was simply called spectral 
dimension, since it was related to the vibrational spectrum. Due to the already 
mentioned universality properties, the above result hold for the very general 
case where oscillating masses and elastic constants may have different values on 
different sites and links, provided they are bounded by positive numbers. More 
precisely, considering the equations of motions 

rUi—Xi = -K'^Jij[xi- x-j) = -K'^Li-jXj (130) 
J j 

for the same graph of H127|) . if H49|) holds together with 

Vi (131) 

then the asymptotic behaviour of the density of vibrational states is still given 
by gni- 

^From all the above properties, it follows that also the spectrum of the Laplacian 
operator L depends on d: indeed it can be shown 10 that the spectral density 
p{l) of L at low eigenvalues behaves as p{l) ^ I ''/^-i. 

The average spectral dimension is crucial in determining the behaviour of the 
oscillating network in equilibrium with a thermal bath at temperature T. Con- 
sidering the Hamiltonian of the system given by (|129|l 

1 

^ ""Yl ^ + 2'"'^° 51 ■^v^iXj (132) 

i ' ij 

and calculating the thermodynamic averages with respect to the Gibbs weight 
exp(— iJ/fcT), where k denotes the Boltzmann constant, one can show that, for 
positive T, 

<a;2> = (x) for d<2 (133) 

while 

< x2 >< 00 for d> 2. (134) 
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This is the generahzation to graphs of the fundamental Peierls result about the 
thermodynamic instability of oscillating crystals in low dimensions. In other 
words, for an infinite oscillating network with d < 2 in equilibrium with a 
thermal bath, the mean square displacement of masses from their equilibrium 
positions would diverge. 



14.2 The Gaussian model 

The Gaussian model is the simplest statistical model used to study magnetic 
systems on lattices. Even if it is not realistic, its properties are fundamental to 
understand more complex and phenomenologically significant models. In field 
theory it is also known as " free scalar field" . The Gaussian model on Q is defined 
by the Hamiltonian: 

H=IY1 '^'('^^y + ^l^v)^J -hY,(t>^ (135) 

ij i 

where (t)i is a real field, J > a ferromagnetic coupling, h an external magnetic 
field and m| = aim? , with 1/K < ai < K for some positive /C^j. Its specific 
free energy fc is given by 

/g( J, ml h) - lim ^F^ - lim 1 log Z (136) 

where Z is the partition function calculated according to the Boltzmann weight 
exp(— _ff). The spectral dimension is related to the singular part of fa for h = 
and — > by: 

Sing if) ^ m". (137) 
The covariance of this Gaussian process reads 

(0,0,) = C,j(to2) = (A + TO2^)r.i (138) 
and hence it satisfies by definition the Schwinger-Dyson (SD) equation 

{J^ + m^^^i) [m^) J^kCkJ{m^) ^ (139) 

fceG 



Setting 

a, = \ ^ ^ , W.,^-^^ (140) 
one obtains the standard connection with the random walk (RW) over G [HI- 



t—O 7: i< — j 

where the last sum runs over all paths from j to i, each weighted by the product 
along the path of the one-step probabilities in W: 

7 = [i, kt-i, . . . , fc2, =^ W[j] = W^k,_,Wk,_,k,^„ . . . , Wk,k,Wk,j (142) 
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Notice that, as long as m > 0, we have < 1 ^'^^ namely the 

walker has a non-zero death probabihty. This imphes that is a smooth 
functions of m? for m > e > 0. In the limit m ^ the walker never dies and 
the sum over paths in eq. H141|l is dominated by the infinitely long paths which 
sample the large scale structure of the entire graph ( "large scale" refers here to 
the metric induced by the chemical distance alone). This typically reflects itself 
into a singularity of Cij at m = whose nature does not depend on the detailed 
form of Jij or rji, as long these stay uniformly positive and bounded. 
Of particular importance is the leading singular infrared behaviour, as — > 0, 
of the average [C(to^)]g of Cii{w?), which is a positive definite quantity, over 
all points i of the graph C/, which we may write in general as 



14.3 Spherical model and 0{n) models 

The spherical model is again a magnetic model with no direct connection to 
phenomenology. Nevertheless, is a little more complex than the Gaussian one 
and, most important, it exhibits phase transitions at finite temperature for 
d > 2. Moreover, its critical exponents can be exactly determined and they 
turn out to be simple functions of d, pointing out the crucial role of the average 
spectral dimension in phase transitions and critical phenomena. The spherical 
model can be defined on a generic graph through the Hamiltonian (|135|l with 
the generalized spherical constraint = N . We assume the coordination 

numbers to be bound: 1 < 2i < Zmax- Its free energy and correlation functions 
can be expressed in terms of the Gaussian ones. Then the critical behaviour is 
obtained from the infrared singularities of the latter, i.e. in terms of the long 
time behaviour of random walks. The results concerning the critical exponents 
are summarized in the following table, where Tc = for d <2: 
The so called 0{n) models are defined, for positive integer n, by the Boltzmann 
weight exp(— /3_ff„), where 



the sum extends to all links of a certain graph Q, Jij > are ferromagnetic 
interactions, which may vary from link to link, and Si is an n— dimensional 
vector of fixed length normalized by Si ■ Si — n. They represent more realistic 
magnetic models, but their exact solution is in general impossible. However, a 
series of complex but powerful inequalities, relating their correlation functions to 
the random walks generating functions, allow proving some very general results 
shedding light on the complicated phenomena concerning phase transitions on 
graphs. In particular it has been proven that: 

• they cannot have phase transitions at T > if is recurrent on the 



Sing [Cim^)]G - c(TO2)<i72-i 



(143) 




(144) 



<ij> 



average; 
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l<d<2 


2 <d<4 




T = Tc 


6 ^ CO 


S^d + 2 
d-2 


(5 = 3 


T<Tc 


- 


7' does not exist 


7' = 1 


T>Tc 


7= 2 
^ d-2 


^ d-2 


7=1 


T <Tc 








T>Tc 






a = 


T<Tc 




"=1 





Table 1: Critical exponents of the spherical model on a graph of spectral di- 
mension d 

• they exhibit phase transitions at T > if ^ is transient on the average; 

• for n ^ 00 their critical exponents tend to the spherical ones. 
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